Multimodal research: Addressing the complexity of multimodal environments and the challenges for CALL

Multimodality, the study of the interaction of language with other semiotic resources such as images and sound resources, has significant implications for computer assisted language learning (CALL) with regards to understanding the impact of digital environments on language teaching and learning. In this paper, we explore recent manifestations of CALL in 3-D virtual worlds, illustrated by the example of Second Life. The multimodal analyses of a conventional face-to-face lesson and three language learning activities in Second Life highlight some of the affordances and challenges presented by 3-D virtual environments. The results suggest that while multimodal resources integrate naturally to facilitate language teaching and learning in an orderly, structured and goal-orientated manner in classroom lessons, the often uncoordinated use (or absence) of avatars' gaze, facial expression, body posture, gesture, as well as the unclear proxemics and use of space pose problems for effective communication in a 3-D virtual world. In addition, a technology-oriented register, alongside traditional instructional and regulative genres and registers, is introduced to help students cope with the demands of learning a language in a 3-D virtual environment. The study raises the issue of the relative effectiveness of 3-D virtual worlds for language teaching and learning. In doing so, a digital approach to multimodal research is proposed in order to address the complexity of multimodal learning environments and the various challenges for CALL

A Mixed Methods Empirical Examination of Changes in Emphasis and Style in the Extremist Magazines Dabiq and Rumiyah

The change in name of ISIS’s flagship English language magazine from Dabiq to Rumiyah prompted media speculation about its significance. This article uses a mixed methods approach that integrates a qualitative social semiotic discourse analysis approach with quantitative methods of information visualisation to examine empirically changes in emphasis and approach in both magazines over time to determine whether the changes are ones of style or substance. The paper argues that, while ISIS has changed its strategic focus over time in response to its changing fortunes, the organisation’s underlying world view, values and ultimate aims remain consistent and unchanged

Interpreting text and image relations in violent extremist discourse: A mixed methods approach for big data analytics

This article presents a mixed methods approach for analysing text and image relations in violent extremist discourse. The approach involves integrating multimodal discourse analysis with data mining and information visualisation, resulting in theoretically informed empirical techniques for automated analysis of text and image relations in large datasets. The approach is illustrated by a study which aims to analyse how violent extremist groups use language and images to legitimise their views, incite violence, and influence recruits in online propaganda materials, and how the images from these materials are re-used in different media platforms in ways that support and resist violent extremism. The approach developed in this article contributes to what promises to be one of the key areas of research in the coming decades: namely the interdisciplinary study of big (digital) datasets of human discourse, and the implications of this for terrorism analysis and research

Frailty index transitions over eight years were frequent in The Irish Longitudinal Study on Ageing.

Background: The frailty index (FI) is based on accumulation of health deficits. FI cut-offs define non-frail, prefrail and frail states. We described transitions of FI states in The Irish Longitudinal Study on Ageing (TILDA). Methods: Participants aged ≥50 years with information for a 31-deficit FI at wave 1 (2010) were followed-up over four waves (2012, 2014, 2016, 2018). Transitions were visualized with alluvial plots and probabilities estimated with multi-state Markov models, investigating the effects of age, sex and education. Results: 8174 wave 1 participants were included (3744 men and 4430 women; mean age 63.8 years). Probabilities from non-frail to prefrail, and non-frail to frail were 18% and 2%, respectively. Prefrail had a 19% probability of reversal to non-frail, and a 15% risk of progression to frail. Frail had a 21% probability of reversal to prefrail and 14% risk of death. Being older and female increased the risk of adverse FI state transitions, but being female reduced the risk of transition from frail to death. Higher level of education was associated with improvement from prefrail to non-frail. Conclusions: FI states are characterized by dynamic longitudinal transitions and frequent improvement. Opportunities exist for reducing the probability of adverse transitions

Informing patterns of health and social care utilisation in Irish older people according to the Clinical Frailty Scale.

Background: There is increasing policy interest in the consideration of frailty measures (rather than chronological age alone) to inform more equitable allocation of health and social care resources. In this study the Clinical Frailty Scale (CFS) classification tree was applied to data from The Irish Longitudinal Study on Ageing (TILDA) and correlated with health and social care utilisation. CFS transitions over time were also explored. Methods: Applying the CFS classification tree algorithm, secondary analyses of TILDA data were performed to examine distributions of health and social care by CFS categories using descriptive statistics weighted to the population of Ireland aged ≥65 years at Wave 5 (n=3,441; mean age 74.5 (SD ±7.0) years, 54.7% female). CFS transitions over 8 years and (Waves 1-5) were investigated using multi-state Markov models and alluvial charts. Results: The prevalence of CFS categories at Wave 5 were: 6% 'very fit', 36% 'fit', 31% 'managing well', 16% 'vulnerable', 6% 'mildly frail', 4% 'moderately frail' and 1% 'severely frail'. No participants were 'very severely frail' or 'terminally ill'. Increasing CFS categories were associated with increasing hospital and community health services use and increasing hours of formal and informal social care provision. The transitions analyses suggested CFS transitions are dynamic, with 2-year probability of transitioning from 'fit' (CFS1-3) to 'vulnerable' (CFS4), and 'fit' to 'frail' (CFS5+) at 34% and 6%, respectively. 'Vulnerable' and 'frail' had a 22% and 17% probability of reversal to 'fit' and 'vulnerable', respectively. Conclusions: Our results suggest that the CFS classification tree stratified the TILDA population aged ≥65 years into subgroups with increasing health and social care needs. The CFS could be used to aid the allocation of health and social care resources in older people in Ireland. We recommend that CFS status in individuals is reviewed at least every 2 years